DOCOMENT RESDHE 



ED 091 H23 



TM 003 637 



AUTHOR 
TITLE 

PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Feirr Betty J.; Toothaker^ Larry E, 

The ANOVA F-Test Versus The Kruskal-Wallis Test: A 

Robustness Study, 

[Apr 74 ] 

38p.; Paper presented at the Annual Meeting of the 
American Educational Research Association (59thr 
Chicago^ Illinois^ April 1974) 

MF-$0.75 HC-$1,85 PLUS POSTAGE 

♦Analysis of Variance ; Comparative Statistics ; 

♦Nonparametric Statistics; Sampling; Statistical 

Analysis ; Statistical Studies 

ANOVA F Test; Kruskal Wallis Test; ^Variance 

(Statistical) 



ABSTRACT 

Researchers are often in a dilemma as to whether 
parametric or nonparametr ic procedures should be cited when 
assumptions of the parametric methods are thought to be violated. 
Therefore^ the Kruskal-Wallis test and the ANOVA F-test were 
empirically compared in terms of probability of a Type I error and 
power under various patterns of mean differences in combination with 
patterns of variance inequality, and patterns of sample size 
inequality. The Kruskal- Walli s test was found to be competitive with 
the ANOVA F-test in terms of alpha but not for power. Power of the 
Kruskal-Wallis test was grossly affected in all but one situation for 
nonstepwise mean differences when sample sizes and variances were 
negatively related and when small levels of significance were 
utilized. The ANOVA F-test, however, was found to be generally robust 
for the types of specified mean differences. (Author) 
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THE ANOVA F-TEST VERSUS THE KRUSKAL-WALLIS TEST: 
A ROBUSTNESS STUDY 
ABSTRACT 
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Researchers are often in a dilemma as to whether parametric or non- 
parametric procedures should be cited when assumptions of the parametric 
methods are thought to be violated. Therefore, the Kruskal-Wallis test 
and the ANOVA F-test were empirically compared in tenns of probability of 
a Type I error and power under various patterns of mean differences in 
combination with patterns of variance inequality, and patterns of sample 
size inequality. The Kruskal-Wal lis test was found to be competitive with 
the ANOVA F-test in terms of alpha but not for power. Power of the Kruskal- 
Wallis test was grossly affected In all but one situation for nonstep- 
wise mean differences when sample sizes and variances were negatively re- 
lated and when small levels of significance were utilized. The ANUVA F- 
test, however* was found to be generally robust for the types of specified 
mean differences. 



THE ANOVAF-TEST VERSUS THE KRUSKAL-WALLIS TEST: 

A ROBUSTNESS STUDY 

Betty J. Feir, Oklahoma State University 
Larry E. Toothaker, University of Oklahoma 

A common problem in applied research is to decide whether or not 
sample differences in central tendency reflect true differences in parent 
populations. It is appropriate to use the one-way fixed effects ANOVA 
F-test for the K-sample case (K >_ 2) if assumptions of normality, homo- 
geneity of variances, and independence of errors are met. When either nor- 
mality or equality of variances is doubtful, the use of nonparametric sta- 
tistical procedures is often recommended (Bradley, 1968). 

The two-sample Mann-Whitney U test is a frequently used ditribution- 
free analogue to the Student^s t-test, and in a one-way ANOVA situation, the 
distribution-free analogue to the F-test is the Kruskal-Wallis rank test 
(Kruskal, 1952). Both of these distribution-free methods have been commonly 
used to test hypotheses about means. In fact, they are generally sensitive 
to differences in location, but specifically sensitive to differences in 
medians. If the popluations are symmetric, then the means and the medians 
are the same. For location differences, the Kruskal-Wallis test as compared 
to the F-test has an symptotic relative efficiency of .95 for the normal 
case, 1.00 for the uniform case, and a lower bound of .864 (Bradley, 1968). 
Thus, not more than 13.6% asymptotic efficiency can be lost using the Krus- 
kal-Wallis test rather than the F-test, and, if the distribution is normal, 
the asymp:otic loss of efficiency is only about 5%. Keeping in mind that 
asymptotic relative efficiencies are computed for unrealistical ly large sam- 
ple sizes with minusclue differences in measures of location, it would seem 
profitable to investigate the efficiency of the Kruskal-Wallis test as com- 
pared to the F-test for realistic sample sizes and realistic differences in 
location (Feir and Toothaker, 1974). 

Research has demonstrated, however, that in certain cases the ANOVA 
F-test as well as other parametric procedures can be said to be "robust" 
or insensitive to assumption violation (Box and Andersen, 1955). Robust^ 
ness creates a dilemma for the researcher: should he or should he not 
utilize nonparametric procedures in lieu of parametric procedures? Many 
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studies have investigated the effect of assumption violation on parametric 
procedures, but very few have directly compared parametric to nonparametri c 
techniques under assumption violation. Nevertheless, literature often re- 
commends distribution-free techniques as being powerful alternatives when 
parametric assumptions are violated (Terry, 1952; Hodges and Lehman, 1961; 
Klotz, 1963; Van der Laan, 1964; Puri , 1964; McSweeney, 1967; Bradley, 
1968; Penfield and McSweeney, 1968; McSweeney and Penfield, 1969). Since 
under assumption violation the F-test appears to be robust and the Kruskal- 
Wallis test appears to be powerful, perhaps the two tests should be com- 
pared under extensive combinations of parametric assumption violations. The 
Dresent research empirically investigates the effect of non-normality 
coupled with a variety of unequal variance conditions, and several types 
of mean differences for the F-test and the Kruskal-Wall is test for five 
levels of significance. Sample size per treatment level as well as total 
sample size are manipulated along with the assumption violations. 

PROCEDURE 

The basic numbers upon which this Monte Carlo study was based were 
obtained via a computer using a pseudo-random number generator. Depending 
upon the assumption violation, the numbers were selected from either a nor- 
mal distribution or from an exponential distribution scaled to have equal 
medians of zero value under the null hypothesis. The random deviates were 
allocated to four treatment levels which comprised a one-way fixed effects 
analysis of variance situation. 

The observations from the normal distribution were derived by a tech- 
nique developed by Box and Muller (1958), which generates pseudo-random \ 
variables distributed N(0,1). For the null situ^ation, the means of the four 
treatment levels were zero. The non-null situation was established by de- 
fining values of y. (see Table 1), j = 1,2,3,4; such that the power for 

J 

the ANOVA F-test would be about .86 for large mean differences and about .60 
for smaller mean differences for the equal variances condition for the nor- 
mal distribution. For each of the theoretical power values, both step- 
wise (1:2:3:4) and nonstepwise (1:4:4:4) differences were determined. Spe- 
cification of the y.'s for the normal distribution was made through the use 
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of the non-central ity parameter, e, (Pearson and Hartley, 1951) where, 

erJc 
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e = 




Setting o'^ = 1 and J .= 4, and using probability of a Type I error equal to 

.05, the values of y. were found in a stepwise and a nonstepwise manner for 

J 

both power values. Since equal sample size cases and unequal sample size 
cases would lead to different values of y the values were calculated for 
both equal and unequal sample sizes. 



Insert Table 1 about here 



The mean differences were used for the non-null situation for all variance 
conditions . 

Four types of variances were established as follows: 1) equal var- 
iances (1:1:1:1); 2) unequal variances, stepwise (1:2:3:41; 3) unequal var- 
iances, with one small variance and three large variances, (SLLL, in the 
ratio of 1:4:4:4); 4) unequal variances with three small variances and one 
large variance (SSSL, in the ratio of 1:1:1:4). The average variance in 
all four cases was approximately equal to unity. 



Insert Table 2 about here 



The exponential distribution was derived by a method given by Leh- 
man and Bailey (1968): 

for f(t)= pe^'P*, with p = 1, 
E(t) = l/p=l, and var(t) = 1/p =1. Pseudo-random exponential variables 
were generated by multiplying the negative of the mean, -E(t) = -1, times 
the natural logarithm of uniform random variates distributed on the unit 
interval (IBM, 1968). The exponential variates were then scaled so that 

the medians would be zero. The resulting skewed population had median 

2 

equal to zero, a variance of a., a skewness measure of yi =2, and a kurtosis 

\i * 
measure of = 6. For this distribution the medians have zero value under 
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the null hypothesis, but the values of means are non-zero. For equal 

variances, the value of the means was .30685. For unequal variances, 

the mean for any group j is .30685 a.. In order to simulate null and 

J 

non-null conditions in the exponential distribution the values of the 

medians for group* j were identical to the values of y . used in the 

J 

normal distribution as shown in Table 1. The variances were also iden- 
tical to those used in the normal distribution as shown in Table 2. 

Comparisons between the ANOVA F-test and the Kruskal-Wal 1 is test 
for equal sample sizes and a total sample size of 28 were made on all 
four variance cases for both the normal distribution and the exponential 
distribution. For three types of unequal sample sizes {(4,6,8,10), 
(4,8,8,8), (6,6,6,10)}, total sample size of 28, comparisons were made 
on all four variance cases which were both positively and negatively 
related to sample sizes for both the normal distribution and the exponen- 
tial distribution. In addition, for a total sample size of 68, two types 
of unequal sample sizes {(11,15,19,23), (11,19,19,19)} were used for com- 
parisons of the F-test and the Kruskal-Wallis with three types of vari- 
ance inequality which were both positively and negatively related to sam- 
ple sizes for both distributions. For each comparison of the F-test to 
the Kruskal-Wallis Test, 1,000 experiments were performed, where an exper- 
iment consisted of computation of each statistical test. The proportion 
of rejections, in 1,000 experiments when there were no location differences 
was determined by comparing the empirical value of each test to five theore- 
tical levels of significance, (.10, .05, .025, .01, .005) and each was re- 
ferred to as empirical alpha. For each empirical alpha, four cases of 
empirical power were calculated by observing the proportion of rejections 
when each of the four types of differences in location was specified. 
(Table 15 summarizes the conditions which were investigated.) 

It should be noted that the equal sample size, equal variance case 
for the normal distribution was included in the present study for the 
purpose of establishing validity of the Monte Carlo method. 

RESULTS 
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Equal Sample Sizes {7,7,7,7} 

Normal population (Table 3): When all assumptions are met, both the 
ANOVA F-test and the Kruskal-Wallis test provide good approximations to 
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theoretical alpha. However, F-test approximations are somewhat closer to 
theoretical alpha than those of the Kruskal-Wallis test in the majority of 
cases. As is expected in this situation, the power of the F-test is higher 
than that of its nonparametri c counterpart for all varidnce cases. In 
addition, the F-test displays only slight variability between power of 
stepwise mean differences and power of nonstepwise mean differences. The 
Kruskal-Wallis test, on the other hand, is greatly affected by the type 
of mean differences and usually displays a predominately higher power for 
stepwise differences than fpr nonstepwise differences. An illustration 
comparing power for the F-test and the Kruskal-Wallis test for a normal 
distribution with equal sample sizes for stepwise inequality of variances 
is shown in Figure 1, which is based on data from Table 3. 

Exponential Population (Table 4): When sampling from an exponential 
population with equal sample sizes, the empirical alphas of both tests 
for unequal variances cases more closely approximate theoretical alpha 
for the smaller values of alpha than when variances are equal. For all 
cases of variance inequality, empirical alphas of the ANOVA F-test and 
the Kruskal-Wallis test fell within two standard deviations of a propor- 
tion to theoretical alpha. Therefore, in terms of alpha alone, neither test 
could be recommended over the other. 

With regard to power, discrimination between the two statistical pro- 
cedures is evident. The Kruskal-Wallis test is generally a more powerful 
procedure than the ANOVA F-test for this case. When differences in 
means are stepwise, for every variance case and at all significance levels 
but one, the Kruskal-Wallis test is slightly more powerful than the F-test. 
Nonetheless, an interesting pattern of power values erupts for nonstep- 
wise mean differences. In the extreme tail regions (a=.01, a=.005), 
where Bradley (1968) indicates that parametric techniques would not be 
. powerful, the ANOVA F-test is more powerful than the Kruskal-Wallis test 
in every instance of nonstepwise differences in means. This again illus- 
trates the differential sensitivity (especially in remote tail regions) of 
the Kruskal-Wallis test to the type of location differences specified. 
It should be noted (see Figure 2 based on Table 4) that as the level of 
significance gets smaller, the variability between the power of stepwise 
and nonstepwise mean differences becomes smaller for the ANOVA F-test and 
O larger for the Kruskal-Wallis test. 

ERIC 
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Unequal Sample Sizes {4,6,8,10} 

Normal population (Table 5): When variances are equal, there is little 
difference between the empirical alphas of the ANOVA F-test and those of 
the Kruskal-Wal 1 is test. For all levels of significance, except a=.10, em- 
pirical values for equal variances are within sampling variability for both 
tests. With positively related sample sizes and variances, both the ANOVA 
F-test and the Kruskal-Wal lis test are conservative (as expected from nor- 
mal theory), with the ANOVA F-test exemplifying much closer approximations 
to all five theoretical alphas than does the Kruskal-Wal 1 is test. There 
appears to be little difference in the empirical alpha values of either test 
as to the type of variance inequality for positive relationships with sam- 
ple sizes (for f variances, 1:4:4:4, the alphas are slightly larger than 
for 1:1:1:4 and 1:2:3:4). However, for negatively related sample sizes and 
variances, where normal theory expectations are liberal, the Kruskal- 
Wal lis test exhibits conservativism for both stepwise unequal variances 
and for unequal variances in the ratio of 1:4:4:4 in the extreme tail re- 
gions. Despite the conservativism in some instances, the empirical alpha 
values for the Kruskal-Wallis test more closely approximate theoretical 
alphas than do those of the F-test for all negatively related cases. In 
addition, the F-test makes more Type I errors than does the Kruskal-Wallis 
test for all negative relationships between sample sizes and variances. 
Solely on the basis of alpha approximations, the Kruskal-Wallis test 
appears to be the better technique for negative relationships between sample 
sizes and variances, but a look at the empirical power values changes the 
perspective. 

The power of both tests for nonstepwise mean differences is consistently 
less than the power for stepwise differences when sample sizes and variances 
are negatively related (See Figure 3, based on Table 5). Further, the 
power of the Kruskal-Wallis test is always lower than that of the ANOVA 
F-test for both types of mean differences, and reduces nearly to zero for 
nonstepwise differences established for small theoretical alphas (when 
a=.005; {1~3)|sjsl ^ '^^^^ .042). In the positively related sample 

sizes and variances cases where alpha approximations for both tests are 
good, the power of the Kruskal-Wallis test is still considerably less than 
the power of the ANOVA F-test. For a normal distribution with stepwise un- 



equal sample sizes, if inequality of variances is suspected, the researcher 
should recognize the deficiency in power of the Kruskal-Wallis test. 

Exponential Population (Table 6): Apparently, the addition of non- 
normality to unequal sample sizes of {4,6,8,10} has little effect on the 
empirical alphas of the ANOVA F-test and the Kruskal-Wallis test. These re- 
sults from the exponential population are similar to the preceding section 
for a normal distribution in that the F-test provides generally closer approx- 
imations to theoretical alpha for positively related cases of sample size and 
variance inequality and the Kruskal-Wallis test provides closer approximations 
for negatively related cases. For stepwise inequality of variances positively 
related to sample sizes, the empirical alphas of both tests are generally 
closer to theoretical alphas than those of the normal distribution, and for 
negative relationships they ,are slightly farther away from theoretical alphas 
than those of the normal distribution. The same unexpected conservati vism 
occurs for the Kruskal-Wallis test when sample sizes and variances are nega- 
tively related for only two cases of theoretical alpha. 

Sampling from an exponential population does have a different effect on 
power. For positively related sample sizes and variances, the power of the 
Kruskal-Wallis test is comparable to or larger than the power of the ANOVA 
F-test in all cases of unequal variances for both types of mean differences. 
Neither the Kruskal-Wallis test nor the ANOVA F-test shows any particular 
trend in power between stepwise and nonstepwise mean differences for the pos- 
itively related cases. But with negatively related cases of sample sizes and 
variances, the power of the Kruskal-Wallis test once again behaves strangely 
(See Figure 4 based on Table 6). When nonstepwise mean differences are speci- 
fied, they are, as shown in previous results, a deterrent to the use of the 
Kruskal-Wallis test in negatively related cases for small theoretical alphas. 
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As seen in Table 6, the power of the Kruskal-Wallis test approaches zero for 
nonstepwise differences in all variance cases. Throughout the entire range 
of theoretical alphas, stepwise mean differences generate larger power values 
for both tests than do nonstepwise mean differences in the negatively related 
sample sizes and variances cases. For small theoretical alphas, the Kruskal- 
Wallis test, even for stepwise mean differences, produces power values less 
than those of the ANOVA F-test in a few instances for the negatively related 
cases. (See Table6; ^ n^s^ ^ a^; SSSL; a = .01, .005). The power of the 
ANOVA F-test for both stepwise and nonstepwise differences does remain fairly 
stable for all levels of theoretical alpha. Due to the instability and lack 
of power for the Kruskal-Wallis test with negatively related sample sizes and 
variances, the researcher should exercise extreme caution in utilizing this 
nonparametric procedure. 

Unequal Sample Sizes {4,8,8,8} {6,6,6,10} 

Due to the multiplicity of data, and the similarity of results, these 
two cases of unequal sample sizes will be grouped together in a generalized 
commentary. 

Normal Population (Tables 7 and 9): When variances are equal, approxi- 
mations to theoretical alpha for both tests and both sample sizes are generally 
good. For the positively related cases of sample sizes and variance inequality, 
both tests are conservative in most cases. The ANOVA F-test and the Kruskal- 
Wallis test do show an unexpected distinct reversal from normal theory in a 
few cases {(Table 7; ^ n's, ^ af; SSSL) (Table 9; ^ n's, ^ a^; SLLL)}, but all 
are within sampling variability of theoretical alpha. For the negatively related 
cases, the Kruskal-Wallis test is usually conservative when a liberal test is 
expected {(Table 7; ^ n's, ^ a^; Stepwise, SSSL, SLLL) (Table 9; n's, ^ 
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Stepwise, SSSL, SLLL)). There are scattered instances where the ANOVA F-test 
is also unexpectedly conservative, but in all cases of this type the ANOVA 
F-test is less conservative than is the Kruskal-Wall is test.. These reversals 
from normal theory could very well be a function of the type of sample size 
inequality in conjunction with the type of variance inequality. Unanticipated 
reversals of this type create a problem for the researcher and further inves- 
tigation in this area is needed. At best, if the Kruskal-Wallis test is used, 
the researcher with sample sizes of this type should expect a conservative test 
no matter what type of variance inequality is suspected. In using the ANOVA 
F-test, normal theory holds in the majority of cases. 

When variances are equal and when variances are positively related to sam- 
ple sizes, there is almost no difference between power of stepwise mean dif- 
ferences and nonstepwise mean differences for either test. Generally, for 
these variance cases, power of the ANOVA F-test is comparable to or better 
than that of the Kruskal-Wall is test. Certainly there is no indication that 
nonparametric power is significantly more enticing than parametric power or 
vice versa . 

In the negatively related sample sizes and variances cases, there is, as 
shown throughout the results, an obvious difference in power between the two 
statistical procedures. Stepwise mean differences produce higher power than 
nonstepwise mean differences for both tests, with the ANOVA F-test having better 
power in practically all cases. Empirical power values of the Kruskal-Wal 1 is 
test for nonstepwise mean differences fall to almost zero for small set alphas, 
and large nonstepwise differences reduce to almost the same empirical power . 
values as those produced by samll nonstepwise mean differences. In other words, 
whether large or small nonstepwise mean differences are specified, the power 
is comparable. Apparently, large nonstepwise mean differences for the Kruskal- 
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Wallis test are severely affected in terms of power for small alphas when var- 
iances and sample sizes are negatively related (Seed Figure 5 based on Table 

7) . Overall, the ANOVA F-test seems to be a better technique in terms of 
power. 

Exponential Population (Tables 8 and 10): When variances are equal 
the Kruskal-Wallis test is slightly conservative for all theoretical alpha 
values, with one expection, for both sample sizes. The ANOVA F-test, however, 
provides empirical alphas that are very close to theoretical alphas for sample 
sizes of {4,8,8,8} and are slightly conservative for sample sizes of {6,6,6,10} 
For small values of theoretical alpha, the ANOVA F-test again shows a rover- 
sal from normal theory when variances and sample sizes are positively re- 
lated. {(Table 8; f n*s, f a^; Stepwise, SLLL) (Table 10; f n's, f a^; SSSL)}. 
The Kruskal-Wallis test is conservative in all cases of positively related sam- 
ple sizes and variances. Empirical alphas for the negatively related cases 
for both of these sample sizes are considerably closer to theoretical alpha 
than were those of the stepwise unequal sample size cases ({4,6,8,10}; Table 
6). In fact, empirical alphas of both tests are consistently within two 
standard deviations of a proportion difference of theoretical alpha. 

As far as power is concerned, the Kruskal-Wallis test displays the same 
lack of power for nonstepwise mean differences for small values of theoretical 
alpha that it has displayed in previous cases. (See Figure 6 based on Table 

8) . For stepwise mean differences, there is only a small difference between 
the power of the ANOVA F-test and the power of the Kruskal-Wallis test, with 
the power of the Kruskal-Wallis test being slightly higher in most cases. 
Nevertheless, the undependability of empirical power of the Kruskal-Wallis test 
in certain situations prevents a recommendation for use as a more powerful 
technique than the ANOVA F-test. 
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Unequal Sample Sizes {1M5a9>23} {11,19,19,19} 

Normal Population (Tables 11 and 13): For positively related sample 
sizes and stepwise unequal variances, empirical alphas of the ANOVA F-test 
and the Kruskal-Wallis test are very similar. The empirical alphas for sam- 
ple sizes of {11,19,19,19} are slightly closer approximations to set alpha than 
are empirical alphas for sample sizes of {11,15,19,23}, but the differences 
are small. When sample sizes and variances are negatively related, the step- 
wise increment in sample sizes of {11,15,19,23} provides closer approximations 
to set alphas than does the nonstepwise increment {11,19,19,19}. Although 
both the Kruskal-Wallis test and the ANOVA F-test are both liberal for both 
sample sizes in the negative related cases, sample sizes of {11,15,19,23} 
produce much more liberal tests than dolsample sizes {11,19,19,19} with empiri- 
cal alphas of the Kruskal-Wallis test most closely approximating theoretical 
alphas in most instances. In fact, throughout the majority of cases investi- 
gated for these sample sizes with a normal distribution and unequal variances, 
the empirical alphas of the Kruskal-Wallis test more closely approximate 
theoretical alphas than do the empirical alphas of the ANOVA F-test. It 
should be noted that both tests show departures from normal theory expectation 
in specific instances (Table 13; f n's, positively related, SSSL; and 

Table 11; ?^ n's, f negatively related, 1:2:3:4). 

In terms of power, stepwise mean differences generally produce higher 
empirical power than nonstepwise mean differences for both statistical tests 
using both types of sample size inequality. The power of the Kruskal-Wallis 
test in the majority of cases is lower than that of the ANOVA F-test. As 
demonstrated throughout this study, for negatively related cases, nonstepwise 
mean differences, the power of the Kruskal-Wallis test is especially low, par- 
ticularly in remote tail regions. Even though the Kruskal-Wallis test would 
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be the recommneded procedure in terms of alpha, the power conscious researcher 
testing at small levels of significance would be seriously handicapped utilizing 
the nonparametric procedure. 

Exponential Population (Tables 12 and 14): There is surprisingly little 
difference between the empirical alphas of the Kruskal-Wal 1 is test and the 
ANOVA F-test for either sample size investigated. Furthermore, there appears 
to be only a negligible effect due to the type of sample size inequality for 
the "large total sample size of 68 coupled with nonnormality. Both tests show depar- 
tive from normal theory conservativism at all alpha levels when variances 
are in the ratio of 1:1:1:4 for positively related sample size and variance- 
inequality (Tables 12 and 13). This was the only variance condition which 
showed deviation from normal theory expectation. In general, for negatively 
related cases of sample size and variance inequality, the Kruskal-Wal 1 is test 
provides slightly better approximations to theoretical alpha than does the 
ANOVA F-test but the differences are small for all but one type of variance in- 
equality (SSSL). In this case, the ANOVA F-test appears to make considerably 
more Type I errors than does the Kruskal-Wal 1 is test. In terms of Type I 
errors, the Kruskal-Wal 1 is test might be the preferred procedure, but the 
differences in alpha approximations are not generally large ^ 

In terms of power, stepwise mean differences produce higher empirical 
power than nonstepwise mean differences for both statistical tests using both 
types of sample size inequality. There is a smaller differential between em- 
pirical power based on stepwise differences and that based on nonstepwise dif- 
ferences for these larger sample sizes coupled with nonnormality than for the 
smaller sample sizes previously discussed. The Kruskal-Wallis test, even for 
nonstepwise mean differences with negatively related sample sizes and variances. 
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generally demonstratos slightly higher power than that of the ANOVA F-test. 
However, the differences between power of the two statistical procedures is not 
large in any case, and one tesi: could not be recommended over the other in 
terms of pov;er. 

SUMMARY AND CONCLUSIONS 

The Kruskal-Wall is test has often been recommended for use in lieu of the 
ANOVA F~test when assumptions of the parametric procedure are violated. On 
the other hand, research has shown the ANOVA F-test to be relatively robust 
to a variety of assumption violations. To better guide the researcher, the 
present study empirically compared the robustness of the Kruskal -Wallis test 
and the ANOVA F-test in terms of probability of a Type I error and power under 
an assortment of varying conditions. 

Upon comparing empirical alphas of the two statistical procedures, it was 
found for equal variances and for positively related sample sizes and variances 
that the ANOVA F-test provided closer approximations to theoretical alphas 
in the majority of cases for both normal and exponential distributions for 
all combinations of sample size inequality when N=28. When sample sizes were 
equal, the two procedures were comparable with the Kruskal-Wall is test pro- 
viding slightly better alpha approximations for the exponential distribution 
and the ANOVA F-test providing slightly better alpha approximations for the 
normal distribution. When sample sizes and variances were negatively related, 
the empirical alphas of the Kruskal-Wallis test generally more closely approxi- 
mated theoretical alphas for both distributions and all combinations of sample 
size inequality but one ({10,6,6,6}, Normal Population). For larger unequal 
sample sizes (N=68), the Kruskal-Wallis test generally demonstrated slightly 
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closer approximations to theoretical alpha for the normal distribution and 
the exponential distribution. 

For both statistical tests when sample sizes and variances were unequal, 
reversals from normal theory alphas were noted in some cases. Both tests 
were conservative for negative relationships and liberal for positive relation- 
shipd in a few cases. These reversals were not found to be particularly 
illustrative of a trend toward poor estimates of theoretical alpha but rather 
simply indicative of specific instances of deviation from normal theory ex- 
pectancy and warrant mention." 

On the basis of alpha approximations alone, the Kruskal-Wallis test was 
found generally to be competitive with the ANOVA F-test when parametric assump- 
tions were violated, but the Kruskal-Wall is test could not be recommended as 
the preferred procedure. 

Power comparisons indicated that when sampling from a normal distribu- 
tion with both positively and negatively related sample sizes and variances, 
the empirical power of the ANOVA F-test was higher than that of the Kraskal- 
Wallis test. When positive relationships of sample sizes and variances were 
present for the exponential distribution, the Kruskal-Wallis test generally 
demonstrated slightly higher power than that of the F-test. However, for 
negative relationships, with sampling from an exponential distribution the 
Kruskal-Wallis test consistently displayed higher power than the F-test only 
when stepwise mean differences were specified, and even then there was little 
difference between empirical power of the Iwo procedures. For nonstepwise mean 
differences, the Kruskal-Wallis test was found to be extremely sensitive. 
Inifact, for small theoretical alphas, the power of the Kruskal-Wallis test 
diminished almost to zero for negative relationships of sample sizes and var- 
iances for both distributions. An interesting point concerning this lack of 
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power for the Kruskal-Wallis test for nonstepwise mean differences was it*s con- 
sistency. The empirical power values were found to be consistently low across 
distributions, across variance patterns, and across sample size patterns for 
N = 28. Due to the lack of power of the Kruskal-Wall is test in these cases, 
a recommendation for use at small alphas, with medium size total samples cannot 
be given on the basis of this research. Further, most researchers have no 
idea about the type of mean differences present in their data, and to expect 
them to be stepwise in nature is unreasonable. Therefore, a researcher utiliz- 
ing small unequal sample sizes suspecting inequality of variances could be 
almost totally without power if testing hypotheses at a=.01 or smaller using 
the Kruskal-Wallis test. The F-test was found to generally . have less power 
with nonstepwise mean differences than for stepwise mean differences in the 
negatively related cases but power for the F-test was much higher than that 
of the Kruskal-Wallis test and showed no indication of diminishing to zero. 
It should be noted, however, that for the larger unequal sample sizes investi- 
gated (N=68), the Kruskal-Wallis test was competitive in terms of power for 
nonstepwise mean differences if the distribution was exponential. But the lack 
of power was still evident for the Kruskal-Wallis test even for larger sample 
sizes for normal distributions. 

In conclusion, when normality and/or homogeneity of variance is doubt- 
ful, the ANOVA F-test was found to be the recommended procedure for testing 
hypotheses ,. especial ly at significance levels of .01 or less with a medium 
size sample. This recommendation is based primarily on the instability of 
power for the Kruskal-Wallis test. If a researcher is unconcerned with power 
or has a large total sample size, the Kruskal-Wallis test could be recommended 
as being competitive to the F-test when assumptions of normality and homogeneity 
of variance are violated. 
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TABLE 1 
Values of n. and v 



•1 


n 

j 




NSL 


"'ss 




1 


7 


0 


.577 


0 


.419 


2 


7 


.67 


.577 


.487 


.419 


3 


7 


1.34 


577 


.974 


.419 


4 


7 


2.01 


2.308 


1.461 


1.676 


1 


A 


0 


.521 


0 


.379 


2 


6 


.707 


.521 


.513 


.379 


3 


8 


1.414 


.521 


1.026 


.379 


4 


10 


2.121 


2.084 


1.539 


1.516 


1 


4 


0 


.553 


0 


.402 


2 


8 


.727 


.553 


.529 


.402 


3 


8 


1 454 


.553 


1.058 


.402 


4 


8 


2.181 


2.212 


1.587 


1.608 


1 


6 


0 


.521 


0 


.379 


2 


6 


.646 


.521 


.469 


.379 


3 


6 


1.292 


.521 


.938 


.379 


4 


10 


1.938 


2.084 


1.407 


1.516 


1 


11 


0 


.315 


0 


.236 


2 


15 


.415 


.315 


.310 


.236 


3 


19 


.830 


.315 


.620 


.236 


4 


23 


1.245 


1.260 


.930 


.944 


1 


11 


0 


.332 


0 


.249 


2 


19 


.426 


.332 


.319 


.249 


3 


19 


.852 


.332 


.638 


.249 


4 


19 


1.278 


1.328 


.957 


.996 



iij = number of observations per treatment level 

\is -a stepwise difference such that power was approximately .86 
for a=.05 for the normal distribution 

\Xa = a non-stepwlse difference (1:1:1:4) such that power was 
approximately .86 for a=.05 for the normal dlstrlbutior. 

yj = a stepwise difference such that power was approximately 
.60 for a=.05 for the normal distribution 

Pjj^gg = a non-stepwlse difference (1:1:1:4) such that power was 
approximately .60 for a==.05 for the normal distribution 
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TABLE 2 
Values of Variances 



i 


=o2 


stepwise 


SSSL* 


SLLL** 


1 


1.0 


.4 


.5714 


.30769 


2 


1.0 


.8 


.5714 


1.23076 


3 


1.0 


1.2 


.5714 


1.23076 


4 


1.0 


1.6 


2.2857 


1.23076 



SSSL - These variances are approximately In the ratio 
1:1:1:4 



** SLLL - These variances are approximately In the ratio 
1:4:4:4 
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TABLE 3 

Normal Population-Equal Sample Sizes (7,7,7,7) 

[Kntrles are the proportion of rejections In 1,000 experiments for the ANOVA F-test (F) and 

tlie Kruskal-W«il lis Test (KW) In terms of probability of a Type I error (a) and power (1- P ) . 

Power Is based on four cases of mean differences (SL-stepwise , large;NSL - nonstepwlse, 

large; SS -stepwise, small: NSS-nonstepwlse , small). Alpha and power are observed under four 

variance cases (= o^; i a|, stepwise; ^ a^, SSSL, approximately In the ratio of 1:1:1:A; and 

y <i2, SLLL, approximately In the ratio of 1:4:A:A)] 
e 

F KW 



(stepwise) 



4 o^(SSSL) 
e 



y a''(SLLL) 
e 



a 


set 


1 n 
.10 


.05 


. 025 


. 01 


.005 


. 10 


.05 


.025 


. 01 


. 005 


a 




.096 


.0A3 


. 019 


.007 


.002 










. \J\J X. 


1- 


^ SL 


.940 


.872 


.765 


.640 


.526 


.921 


.817 


.702 


.505 


.361 


1- 


^ NSL 


.936 


.875 


.803 


.662 


.569 


.905 


.832 


.703 


.480 


.313 


1- 


3 SS 


.719 


.601 


.485 


.325 


.234 


.676 


.538 


.404 


.226 


.121 


1- 


3 NSS 


.749 


.613 


.477 


.331 


.233 


.697 


.546 


.376 


.196 


.104 


a 




.lOA 


.063 


.042 


.018 


.009 


.111 


.054 


.024 


.005 


.004 


1- 


PSL 


.957 


.900 


.814 


.675 


.579 


.951 


.880 


.754 


.582 


.421 


1- 


Q NSL 


.899 


.829 


.756 


.645 


.552 . 


.831 


.713 


.594 


.425 


.275 


1- 


^ SS 


.719 


.590 


.459 


.322 


.241 


.704 


.547 


.401 


.240 


.150 


1- 


3 NSS 


.678 


.551 


.429 


.301 


.231 


.604 


.430 


.302 


.172 


.102 


a 




.103 


.056 


.028 


.014 


.009 


.091 


.035 


.014 


.007 


.003 


1- 


P'SL 


.921 


.855 


.774 


.668 


.557 


.923 


.836 


.726 


.536 


.419 


1- 


J NSL 


.856 


.798 


.719 . 


.601 


.526 


.753 


.642 


.515 


.339 


.236 


1- 


^ SS 


.693 


.576 


.449 


.318 


.258 


.692 


.540 


.384 


.232 


.145 


1- 


^ NSS 


.645 


.555 


.459 


.350 


.276 


.536 


.397 


.260 


.147 


.084 


a 




.098 


.060 


.025 


.007 


.004 


.101 


.051 


.017 


.007 


.003 


1- 




.962 


.910 


.823 


.684 


.578 


.958 


.907 


.794 


.593 


.437 


1- 




.931 


.860 


.781 


.678 


.570 


.898 


.797 


.682 


.496 


.334 


1- 


^ SS 


.735 


.588 


.446 


.292 


.206 


.758 


.586 


.406 


.222 


.122 


1- 


^ NSS 


.709 


.581 


.455 


.317 


.247 


.666 


.504 


.361 


.191 


.104 
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TABLE A 

Exponential Population-Equal Sample Sizes {1 yl yl yl) 

[Entries are the proportion of rejections In 1,000 experiments for the ANOVA F-Test (F) and 
the Kruskal-Wallls Test (KW) In terms of probability of a Type T error (a) and power (1-3). 
Power Is based on four cases of mean differences (SL-stepwi , large; NSL - nonstepwlse, 
large; SS-stepwlse .small : NSS-nons tepwise , small). Alpha and power are observed under four 
variance cases (= o^; ^ a^, stepwise; 4 a^, SSSL, approximately in the ratio of 1:1:1:A; and 
4 o^, SLLL, approximately in the ratio of 1:4:A:A)] 

F KW 

a set .10 ^.05 .025 .01 .005 .10 .05 .025 .01 .005 



(stepwise) 



1^ SSSL 



4 o SLLL 
e 



a 

1-3 
1-^3 



SL 
NSL 
^ SS 
NSS 



1-1 



a 
1- 
1- 



SL 
?I3L 
SS 



1-3 

1- f-^ 

1-P 
1-P 

a 

1-3 
1-3 
1-3 
1-3 



NSS 



SL 
NSL 
SS 
NSS 



SL 
NSL 
SS 
NSS 



.09A 


.045 


.017 


.005 


.000 


.099 


.052 


.014 


.002 


.001 


.919 


.867 


.793 


.685 


.616 


.959 


.910 


.860 


.715 


.599 


.936 


.895 


.817 


.722 


.630 


.980 


.938 


.852 


.638 


.427 


.768 


.643 


.532 


.397 


.329 


.855 


.749 


.615 


.445 


.315 




.640 


.531 


.388 


.290 


.874 


.739 


.573 


.341 


.180 


.09A 


.054 


.025 


.009 


.006 


.109 


.052 


.024 


.008 


.004 


.988 


.956 


.902 


.821 


.742 


.995 


.984 


.963 


.898 


.826 


.961 


.931 


.878 


.794 


.712 


.991 


.967 


.886 


.696 


.501 


.878 


.768 


.638 


.453 


.350 


.950 


.879 


.790 


.607 


.474 


.80A 


.698 


.583 


.446 


.355 


.890 


.777 


.615 


.370 


.200 


.116 


.059 


.026 


.010 


.009 


.104 


.054 


.024 


.006 


.004 


.97A 


.951 


.906 


.838 


.761 


.988 


.974 


.946 


.872 


.800 


.986 


.965 


.924 


.840 


.V64 


.997 


.977 


.915 


.763 


.544 


• 849 


.748 


.637 


.488 


• 392 


.915 


.834 


.740 


.588 


.453 


.860 


.763 


.658 


.482 


• 375 


.899 


.797 


.636 


.359 


.215 


.092 


.047 


.023 


.010 


.008 


.103 


.052 


.022 


.009 


.004 


.976 


.959 


.916 


.832 


.752 


.997 


.988 


.966 


.919 


.846 


.946 


.894 


.822 


.725 


.640 


.985 


.951 


.850 


.645 


.439 


.884 


.794 


.671 


.517 


.389 


.967 


.918 


.834 


.656 


.512 


.770 


.671 


.558 


.429 


.338 


.903 


.781 


.612 


.372 


.203 
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TABLE 5 

Monsal Population-Unequal Sataple Sizes, (A, 6, 8, 10) 

iKntries are the proportion of rejections in 1,000 experiments for the ANOVA F-test (F) and 
the Krusknl -Wallla Test (KW) in terms of probability of a Type T error (a) and power (1-6). 
Power Is bflsod on four cases of mean differences (SL-stepwlsc, large; NSL-nonstcpwisc , 
large; SS-stupwlse , small: NSS-nonatepwise , Btnall) . Alpha and power are observed under four 
variance cases (- o|; ^ og, stepwise; 4 cj^, SSSL, approximately in the ratio of 1:1:1: A; and 
y <t2, SLLL, approximately in the ratio of itUtU\U)] 

F KW 



4 n's 

- ^2 



4 n's 

4 (stepwise) 

positively related 

4 n's 

^ (stepwise) 
e 

ne^atfvely related 
?l n's 
i .j2 (SSSL) 
ptisl lively related 
4 n's 
4 (SSSL) 
negatively related 
y n's 
,< o2 (SIXL) 

positively related 

i n's 

^ o2 (SLLL) 



1-0 SL 



-6 



' NSL 

SS 
' NSS 



SL 

; NSL 
; SS 
NSS 



SL 
NSL 
SS 
NSS 



1 
1 
1 

1- {< 



SL 
NSL 
SS 
NSS 



-P 



1-P 
a 

1-P 
1- 
1- 
1- 



SL 
NSL 
SS 
NSS 



SL 
' NSL 

;ss 

NSS 



negatively related i- & 



SL 
NSL 
SS 
NSS 



.10 


.05 


.025 


.01 


.005 


.10 


.05 


.025 


.01 


.005 


.127 


.052 


.030 


.012 


.007 


.126 


.050 


.022 


.005 


.001 


.927 


.860 


.791 


.652 


.545 


.906 


.821 


.685 


.488 


.341 


.922 


.859 


.781 


.651 


.559 


.909 


.833 


.718 


.545 


.399 


7 




. 464 


n ft 


« ^ jy 


. 680 


. 523 


. 382 


.199 


. 100 


.732 


.600 


.467 


.314 


.231 


.699 


.538 


.384 


.220 


.118 


.078 


.0^0 


.017 


.005 


.003 


.081 


.032 


.011 


.003 


.002 


.931 


.865 


.780 


.644 


.512 


.933 


.840 


.706 


.490 


.314 


.901 


.828 


.738 


.597 


.501 


.876 


.786 


.664 


.477 


.339 


AQ 1 
. D7l 


. 3 Z 7 


. 401 




. XO J 


. 670 


. 490 


. 338 


. 179 


.089 


.655 


.530 • 


.404 


.27.6 


,207 


.622 


.468 


.329 


.199 


.118 


.163 


.082 


.048 


.023 


.010 


.112 


.057 


.028 


.004 


.001 


.9AA 


.906 


.849 


.752 


.672 


.920 


.860 


.759 


.597 


.443 


.7A5 


.636 


.549 


.441 


.363 


.595 


.460 


.308 


.112 


.047 


.802 


.675 


.575 


.429 


.337 


.747 


.593 


•450 


.262 


.154 


.5^1 


.430 


.335 


.228 


.168 


.412 


.277 


.156 


.050 


.023 


.077 


.OAl 


.017 


.008 


.005 


.078 


.036 


.007 


.002 


.000 


.906 


.841 


.759 


.618 


.517 


.'897 


.807 


.688 


.497 


.353 


.906 


.829 


.740 


.613 


.5>7 


.872 


.778 


.653 


.476 


.337 


.699 


.552 


.426 


.284 


.208 


.665 


.510 


.348 


.185 


.105 


.676 


.556 


.440 


.291 


.215 


.632 


.492 


.343 


.187 


.113 


.188 


.120 


.085 


.050 


.038 


.126 


.076 


.034 


.007 


.002 


.967 


.92K 


.874 


. 782 


.706 


.953 


.884 


.806 


.662 


,512 


.702 


.616 


.527 


.455 


.379 


.539 


.403 


.271 


.085 


.026 


.798 


.68J 


.571 


.469 


.377 


.752 


.607 


.459 


.291 


.193 


.509 


.421 


.338 


.264 


.201 


.356 


.261 


.162 


.05S 


.016 


.099 


.04b 


.025 


.008 


.007 


.088 


.038 


.015 


.005 


.003 


.937 


.868 


.781 


.639 


.530 


.919 


.846 


.700 


.498 


.325 


.920 


.863 


.783 


.658 


.550 


.904 


.820 


.716 


.5.32 


.397 


.679 


.531 


.412 


.255 


.166 


.668 


.503 


.342 


.173 


.101 


.680 


.550 


.421 


.280 


.189 


.660 


.497 


.350 


. 180 


.100 


.U8 


.079 


.058 


.024 


.015 


.122 


.059 


.026 


.010 


.002 


.966 


.924 


.875 


.772 


.698 


.953 


.905 


.819 


.625 


.481 


.756 


.638 


.539 


.413 


.318 


.677 


.502 


.315 


.109 


.042 


.767 


.652 


.547 


.395 


.304 


.752 


.601 


.443 


.255 


.158 


.507 


.374 


.272 


,167 


.122 


.423 


.270 


.142 


.053 


.024 
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TABLE 6 

Exponential Population-Unequal Sample Sizes, (A, 6| 6, 10) 

(Entries are the proportion of rejections In 1,000 experiments for the ANOVA F-tesr (F) and 
the Kruskal-Wallls Test (KW) in terms of probability of a Type I error (a) and power (1-6). 
Power is bnscd on four cases of mean differenced (SL-scepwise , large;NSL - nonscepwlse, 
large; SS-stepwlsc, small^ NSS-nonstepwise, small). Alpha anci powor are observed under four 
variance cases (* cj|; ^ cj|, stepwise; ^ a^, SSSL, approximately in the ratio of 1;1;1:A; and 
t* Og, SLLL, approximately in the ratio of 1:A:A:A)] 



(1 set 



2 

4' 

^ n's 

^ o (stepwise) 

piisitively related 
« n 's 
y (stepwise) 

negatively related 



¥ (SU.I.) 



1- 


c 


SL 


1- 


P 


NSL 


I- 


P 


ss 


I- 


e 


N3S 


(1 






1- 


e 


SL 


1- 




NSL 


1- 




SS 


1- 




NSS 


n 






1- 




SL 


1- 




NSL 


1- 


e 


SS 


1- 


e 


NSS 



-P 



y (SSSL) 
positively related 

y n's 

y (SSSL) 

nrj;ativcly related 

^ nVs 
y cj2 (SU.I.) 

positively related 



P SL 
<?NSL 



SS 
NSS 



-P.SL 
^>SL 
" ^ SS 
" ^ NSS 



PSL 
^ NSL 
SS 
NSS 



m'j»at1vclv reialed }. 



V SI 
" NSl. 

''ss 



• ID 


.05 


F 

.025 


.01 


.005 ■ 


.10 


.05 


KW 

.025 


.01 


.005 


.094 


.048 


.029 


.017 


.010 


. 101 


.043 


.016 


.010 


.004 


.941 


.876 


.811 


.708 


.627 


.957 


.910 


.840 


.732 


.617 


.941 


.899 


.824 


.701 


.605 


.974 


.949 


.888 


.737 


.581 


.745 


.626 


.538 


.384 


.295 


.846 


.738 


.634 


.458 


.332 


.768 


.640 


.544 


.394 


.309 


.686 


.796 


.646 


.465 


.302 


.075 


.029 


.020 


.010 


.006 


.081 


.034 


.015 


.006 


.002 


.946 


.902 


.847 


.739 


.644 


.981 


.951 


.912 


.808 


.675 


.921 


.871 


.798 


.682 


.609 


.977 


.934 


.8^7 


.739 


.579 


.799 


.662 


.547 


.388 


.294 


.886 


.800 


.694 


.537 


.370 


.7 80 


.663 


.541 


.394 


.300 


.887 


.798 


.665 


.463 


.299 


.165 


.105 


.054 


.032 


.019 


. 156 


.084 


.043 


.012 


.004 


.991 


.976 


.949 


.902 


.847 


.997 


.992 


.975 


.925 


.858 


.854 


.763 


.675 


.562 


.464 


.866 


.650 


.382 


.131 


.055 


.911 


.832 


.739 


.611 


.520 


.959 


.894 


.828 


.639 


.480 


.631 


.517 


.418 


.295 


.222 


.619 


.407 


.229 


.087 


.029 


.064 


.036 


.019 


.010 


.003 


.075 


.035 


.016 


.001 


.000 


.964 


.921 


.867 


.777 


.688 


.979 


.959 


.917 


.831 


.722 


.968 


.931 


.872 


.775 


.687 


.990 


.971 


.917 


.816 


.680 


.796 


.670 


.561 


.404 


.306 


.878 


.788 


.675 


.505 


.385 


.808 


.714 


.574 


.402 


.305 


.914 


.823 


.707 


.494 


.344 


.179 


.103 


.059 


.031 


.020 


.130 


.070 


.043 


.012 


.006 


.976 


.956 


.924 


.872 


.809 


.991 


.977 


.954 ' 


.886 


.788 


.871 


.803 


.713 


.583 


.507 


.873 


.660 


.393 


.131 


.045 


.876 


.814 


.736 


.607 


.506 


.921 


.857 


.761 


.588 


.446 


.670 


.549 


.439 


.318 


.235 


.583 


.341 


. 159 


.054 


.018 


.071 


.030 


.016 


.010 


.005 


.083 


.033 


.017 


.009 


.004 


.960 


.916 


.848 


.729 


.638 


.976 


.954 


.909 


.801 


.678 


.944 


.889 


.818 


.716 


.600 


.983 


.945 


.886 


.732 


.586 


.798 


.682 


.548 


.409 


.304 


.902 


.809 


.712 


.526 


.400 


.745 


.628 


.487 


.350 


.282 


.885 


.774 


.626 


.408 


.264 


.140 


.083 


.046 


.021 


.015 


.142 


.082 


.034 


.011 


.002 


.987 


.965 


.929 


.869 


.799 


i.noo 


.995 


.979 




.843 


.825 


.731 


.630 


.510 


.408 


.a7S 


.663 


. 399 


.157 


.077 


.913 


.843 


.727 


.595 


.466 


.970 


.919 


.841 


.645 


.463 


.622 


.502 


.388 


.273 


.210 


.659 


.412 


.232 


.086 


.038 
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TABLE 7 



Normal Populatlon*Unequal Sample Sizes. (A, 8» 6, 8) 

(Entries ^vc the proportion of rejections In 1,000 experiments for the ANOVA F~test (F) and 
the Kruskal-Wallls Test (KW) in terms of probability of a Type I error (a) and power (1-6). 
Power Is based on four cases of mean differences (SL-stepwise , larg'e;NSL - nonstepwlse, 
large; SS-stepwlsc • small; NSS-noustepwise. small), Alpha and power arc observed under four 
variance cases ( - ii^. y ^^2^ stepwise; j< o*, SSSL, approximately In the ratio of 1:1: 1 and 
y, o^, SLLL, approximately In the ratio of 1:A:A:A)] 

F KW 



u set 



y nVs 



y n's '« 
y nj; (SSSI.) ]\ 



positively relatod 



y n»s 



NSL 

ss 

NSS 



2 ^" 
^ 0^ (stepwise) l- 

1- 

posltlvely related l- 

y n's a 

J 1- 
y ^stepwise) i- 

1- 

negiitivcly related i. 
y n*s a 

7 1-P 

y (SSSL) 1- 1< 
i-p 

positively rrl.Ttod j- 



^ NSS 



P SL 
P NSL 

^ SS 

p 

NSS 



SL 
NSL 
SS 
NSS 



I- [< 

nOK'it ivfly rrlatod ^, 

y n's (1 
y oj( (SLLL) 

1- 



SL 
NSL 
SS 
NSS 



SL 
NSL 
SS 
NSS 



y o2 (SI.LL) ilf S!:, 



1-e 

negal (voly <*0£ated i-r 



NSL 
SS 
NSS 



.10 


.05 


.025 


.01 


.005 


.10 


.05 


.025 


.01 


.005 


. 092 


.042 


.021 


.OOB 


.005 


.090 


.037 


.016 


.006 


.002 


.935 


. 865 


. 788 


.664 


. 566 


.907 


.836 


.702 


.518 


.353 


.937 


. 878 


.798 


.675 


.562 


.921 


.838 


.705 


.516 


.359 


.745 


.620 


.484 


.342 


.244 


.703 


.557 


.398 


.209 


.117 


.706 


.574 


.A65 


.312 


.228 


.677 


.530 


.364 


.198 


.111 


. 086 


. 042 


.025 


.006 


. 004 


.082 


.034 


.014 


.007 


.003 


. 9A5 


. 878 


. 798 


.658 


. 548 


.919 


. 842 


.725 


.511 


.351 


.946 


. 874 


. 794 


.669 


. 553 


.915 


. 820 


. 687 


.503 


.346 


.709 


.573 


.456 


.300 


.220 


.681 


.516 


.355 


.193 


.109 


.708 


.575 


.465 


.32 7 


.234 


.654 


.519 


.365 


.207 


.125 


. 124 


. 061 


.031 


.013 


.011 


.105 


.047 


.018 


.007 


.002 


. 956 




.835 


. 708 


.616 


.945 


.855 


. 760 


.567 


.409 


. 769 


.670 


.553 


.418 


. 303 


. 655 


.489 


. 313 


.090 


. .0?8 


.781 


.667 


.542 


. 38A 


.298 


.747 


.594 


.A37 


.270 


.167 


.554 


.420 


.319 


.208 


.142 


.461 


.293 


.157 


.045 


.014 


.106 


.054 


.027 


.011 


.004 


.111 


.046 


.020 


.003 


.001 


.949 


.889 


.817 


.706 


.609 


.932 


.848 


.747 


.545 


.401 


.916 


.853 


.778 


.666 


.568 


.881 


.789 


.662 


.483 


.328 


.713 


.577 


.463 


.329 


.234 


.671 


.514 


.382 


.210 


.129 


.709 


.576 


.455 


.309 


.230 


.640 


.495 


.345 


.189 


.106 


.126 


.070 


.043 


.024 


.013 


.094 


.050 


.021 


.003 


.000 


.951 


.911 


.852 


.742 


.659 


.93'i 


.859 


.764 


.592 


.44u 


.784 


.699 


.592 


.471 


.388 


.636 


.501 


.321 


.097 


.030 


.782 


.677 


.553 


.414 


.314 


.732 


.589 


.444 


.257 ' 


.151 


.563 


.448 


.351 


.251 


.179 


.455 


.290 


.163 


.050 


.018 


.080 


.042 


.021 


.010 


.004 


.080 


.033 


.011 


.005 


.000 


.938 


.891 


.806 


.685 


.571 


.933 


.849 


.722 


.541 


.371 


.935 


.870 


.783 


.663 


.573 


.917 


.809 


.699 


.524 


.358 


.711 


.563 


.A27 


.261 


.196 


.684 


.526 


.346 


.178 


.092 


.691 


.555 


.425 


.295 


.218 


.664 


.497 


.341 


.184 


.098 


.092 


.049 


.029 


.007 


.004 


.092 


.042 


.018 


.006 


.002 


.966 


.916 


.837 


.711 


.600 


.960 


.897 


.768 


.568 


.414 


.788 


.656 


.543 


.408 


.315 


.702 


.512 


.311 


.101 


.039 


.784 


.671 


.560 


.383 


.260 


.766 


.629 


.469 


.236 


.125 


.556 


.408 


.289 


.172 


.120 


.474 


.291 


.158 


.044 


.015 
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TABLE B 

Kxpo'icntial Populutlon-Vnoqual Sample Sizes, 8, 8, 8) 

(Kntrlos nrc t\\e proportion of rejections In 1,000 experiments for the ANOVA K-tCMt (K) and 
the Kruskal-WalHs Test (KW) in terms of probability of a Type i error (a) and puwor ). 
Power Ifl bused on four cases of mean differences (SL-stepwlsc , large; NSL - nonstcpwlse, 
large; SS-stepwisc, small^ MSS-nonscepwise, small). Alpha and power are observed under four 
variance cases ("> o^i ¥ c^gi stepwise; ^ SSSL, approxlmarely in the ratio of 1:]:J:A; and 
y cj*, SLLL, approximately in the ratio of 1:A:A:A)] 

F ' KW 



2 



^ n's 



negatively related 

¥ n's 
¥ n2 (SSSL) 



fiegat fvc'ly re J ;j ted 

y n's 
¥ (SM.L) 

pns i I i Vf 1 y rel nt ed 

¥ al iSLlA.) 
negatively related 



(J 


Set 


.01 


.05 


.025 


.01 


.005 


.01 


.05 


.02?i 


.01 


.005 


a 




.095 


.051 


.026 


.012 


.008 


.095 


.042 


.020 


.004 


.000 


1- 


P SL 


.922 


.868 


.809 


.712 


.607 


.961 


.922 


.854 


.729 


.584 


1- 


^ NSL 


.9bO 


.897 


.842 


.722 


.628 


.985 


.948 


.865 


.684 


.500 


1- 


ss 


.776 


.655 


.545 


.415 


.323 


.874 


.774 


.664 


.478 


.340 


l- 


^ NSS 


. 766 


.650 


.533 


Ann 


. JU7 


. OO / 


. / D £ 


. 0^0 


. J /o 


. ^ 1 J 


a 




.067 


.037 


.020 


.008 


.006 


.076 


.033 


.015 


.005 


.002 


1- 


^ SL 


.938 


.887 


.817 


.709 


.625 


.970 


.932 


.878 


.768 


.649 


1- 


^ NSL 


.938 


.880 


.805 


.714 


.640 


.981 


.941 


.856 


.670 


.497 


1- 


P ss 


.775 


.653 


.546 


.386 


.286 


.883 


.794 


.683 


.478 


.332 


1- 


NSS 


.766 


.664 


.561 


.424 


.305 


.886 


.764 


.620 


.418 


. 250 


(X 




.099 


.055 


.035 


.017 


.011 


,122 


.048 


.017 


.004 


.003 


1- 


P SL 


.968 


.935 


.899 


.806 


.728 


.992 


.973 


.931 


.833 


.732 


1- 


^ NSL 


.830 


.7^1 


.633 


.494 


.418 


.866 


.632 


.329 


.096 


.041 


l- 


P SS 


.816 


.728 


.619 


.488 


.384 


.907 


.809 


./04 


.534 


.386 


l- 


^^NSs 


. 590 


.4^9 


.339 


. 230 


.167 


.591 


.345 


. J78 


.051 


.017 


a 




.078 


.034 


.018 


.007 


.005 


.090 


.036 


.013 


.005 


.001 


l- 


P SL 


.955 


.9U 


.850 


.747 


.663 


.975 


.940 


.886 


.774 


.640 


1- 


^NSL 


.958 


.911 


.848 


.742 


.671 


.981 


.954 


.883 


.722 


.558 


1- 




.796 


.675 


.561 


.438 


.333 


.881 


.795 


.675 


.496 


.349 


1- 


P 

NSS 


.787 


.662 


.543 


.408 


.310 


.890 


.796 


.646 


.394 


.234 


u 




.111 


.056 


.025 


.007 


.005 


.101 


.051 


.021 


.004 


.002 


1- 




.968 


.930 


.878 


.798 


.730 


.988 


.967 


.926 


.820 


.703 


1- 


" NSL 


.875 


.781 


.701 


.571 


.464 


.890 


.671 


.394 


.118 


.036 


1- 


Pss 


.83^ 


.764 


.681 


.538 


.454 


.907 


.829 


.713 


,541 


.413 


1- 


NSS 


.639 


.523 


.420 


.301 


.234 


.641 


.402 


.205 


.058 


.020 


11 




.07^ 


.042 


.020 


.010 


.006 


.083 


.033 


.015 


.007 


.002 


l- 




.9^1 


.900 


.827 


.732 


.655 


.978 


.949 


.909 


.790 


.652 


1- 


^NSL 


.9^2 


.889 


.818 


.706 


.622 


.983 


.940 


.851 


.677 


.513 


1- 




.770 


.661 


.549 


.408 


.298 


.887 


.783 


.673 


.479 


.357 


1- 


* NSS 


.757 


.658 


,527 


.386 


.284 


.904 


.775 


.616 


.362 


.214 


u 




.088 


.047 


.021 


.015 


.010 


.095 


.051 


.024 


.007 


.003 


1- 


^'SL 


.965 


.932 


.878 


.777 


.702 


.992 


.971 


.935 


.831 


.726 


1- 


NSL 


.812 


.708 


.608 


.493 


.387 


.836 


.624 


.316 


.100 


.041 


1- 




.8^5 


.740 


.620 


.479 


. 375. 


.928 


.837 


.732 


.552 


.401 


1- 


P NSS 


.587 


.471 


.366 


.254 


.192 


.633 


.386 


.211 


.068 


.021 
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TABLE 9 

Normal PopulaCion-Unequal Sample Sizts, (6, 6, 6, XO) 

(Entries ore the proportion of ' rejections in 1,000 experiments for the ANOVA F-test (F) and 
The Kruskal-Wallis Test (KW) in terms of probability of Q Type T error (a) auu itouer (1-0). 
Power is based on four cases of mean differences (SL'^srepwisc , largcSNsL-nonstcpwisc » 
large; SS-stcpwlsc, small: NSS-nonatepwise , small). Alpha and power arc observed under four 
variance cases (» a|; y a|, stepwise; ^ a^, SSSL, approximately in the ratio of 1:1:1:4; and 
y a^, SLLL, approximately in the ratio of 1:A:4:A)] 



KW 



^ n's 

2 



^ n'H 
y (slepwJse) 

positively related 

y n's 

^ 0 (stepwise) 

negatively related 



Vt n's 
y 0^ (SSSL) 

positively related 

y .1^ (SSSI.) 
lU-gatlvcly re lilted 

y n's 
y n*^ (Sl.l.l.) 
positively rel;ile<l 

y (i^ (SM.h) 
negatively related 



a 


set 


.10 


.05 


.025 


.01 


.005 


.10 


.05 


.025 


.01 


.005 


? 




.113 


. UDi. 




m n 


nno 


.095 


.03 J 


. 020 


. 006 


. 001 




^ SL 


. 948 


. yuu 


. 824 


.679 


^ 7 ^ 


. 9 JO 


. 853 


. 74 J 


. dhO 


. 399 




^ NSL 


.940 


. O / J 


7Q0 


. DOl' 


. J o*» 




D 1 1 
. o J3 


. /Jo 


Q A /I 


TOO 
. JOO 




ss 


.724 


.603 


.486 


197 


* MO 


.696 


Q T A 


. JO / 


Oil 


. 143 


1- 


^ NSS 


.739 


.617 


.479 


.327 


.240 


.720 


.552 


.402 


.232 


.140 






• KJ f J 


.035 


n on 


. 012 


.005 


.071 


.036 


.015 


.003 


• 001 




n 


• 7 JD 


. OD 7 


"7 A ^ 




.486 


.928 


.842 


.722 


.524 


.374 




P NSL 




. 800 


. 701 


• 300 


.482 


. 840 


. 7 37 


.603 


• 448 


1 Oft 






. D7D 


. 565 


All 


.287 


. 196 


. 706 


.541 


•1 TO 


.225 


1 ->Q 


1- 


NSS 


.665 


.521 


.395 


.258 


.190 


.607 


.455 


.308 


.168 


.107 






1 no 


.052 


.031 


.010 


.003 


. 102 


.045 


. U 1 O 


.003 


• 000 




^ SL 


. 7DU 




. ol^ 


.683 


. 588 


.939 


. 847 


.727 


.550 


.417 




a 

^NSL 


. O J J 


. 769 


.665 


. 525 


.414 


. 797 


.668 


.518 


. 303 


. 163 




Jss 




.646 


.310 


. 366 




.739 


.583 


• 443 


.240 


. 140 




NSS 


.606 


.483 


.361 


.237 


.175 


.534 


.389 


.248 


.116 


.062 






• 057 


• 033 


.021 


.009 


.006 


.069 


.032 


.011 


.005 


.002 




P SL 


.852 


.773 


.632 


.482 


.396 


.875 


.771 


.623 


.442 


.315 




^NSL 


.831 


.728 


.636 


.512 


.427 


.753 


.631 


.508 


.341 


.226 




^ss 


.559 


.444 


.327 


.215 


.156 


.607 


.430 


.304 


.167 


.106 




^' NSS 


.569 


.445 


.337 


.235 


.175 


.506 


.364 


.257 


.153 


.099 






.103 


.064 


.030 


.012 


.007 


.105 


.058 


.022 


.005 


.003 




PsL 


.940 


.873 


.812 


.693 


.589 


.916 


.836 


.73z 


.556 


.421 




^SL 


.832 


.758 


.652 


.500 


.424 


.771 


.642 


.495 


.300 


.156 






.753 


.626 


.501 


.367 


.271 


.707 


.547 


.402 


.249 


.147 




'^NSS 


.638 


.496 


.382 


.253 


.173 


.552 


.394 


.251 


.121 


.066 






.102 


.047 


.021 


.009 


.006 


.087 


.032 


.019 


.005 


.001 




f^SL 


.942 


.894 


.803 


.641 


.527 


.961 


.900 


.7o7 


.568 


.378 




f^NSI. 


.935 


.872 


.795 


.644 


.532 


.917 


O / O 

. .1 


.713 


.507 


.351 




^SS 


.709 


.576 


.432 


.293 


.206 


.744 


.596 


.427 


.238 


.135 




^NSS 


.693 


.557 


.432 


.301 


.219 


.669 


.517 


.352 


.201 


.125 






.101 


.048 


.028 


.011 


.007 


.089 


.036 


.012 


.007 


.003 




PsL 


.945 


.882 


.831 


.705 


.591 


.923 


.854 


.748 


.557 


.410 




^NSL 


.875 


.795 


.693 


.540 


.439 


.844 


.098 


.540 


.335 


.181 






.746 


.622 


.498 


.363 


.256 


.729 


.580 


.420 


.233 


.135 




^NSS 


.641 


.490 


.363 


.237 


.172 


.577 


.400 


.251 


.137 


.065 
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TABLE 10 

Enponentlal Populatlon-Unftqual Simple Slsesi (6| 6, 6, 10) 

[Entries are the proportion of rejections In 1,000 experiments for the ANOVA F-test (F) i^nd 
the Kruskal'Wallls Test (KW) In terms of probability of a Type I error (a) and power (l*- 0) . 
Pownr Is based on four cases of mean differences (SL-stepwlse , large;NSL-non8Cepwlse, 
large; SS-stepwlse, small: NSS-nonstepwlse , small). Alpha and power are observed under four 
variance caaes (- o^; y cj|, stepwise; i o|, SSSL, approximately In the ratio of 1:1:1;A; and 
y n^, SLLL, approximately In the ratio of 1:A:A:A)] 

F KW 



a set 



i n*3 

y (stepwise) 
positively related 

i n*s 

y a2 (stepwise) 

negatively related 

y o2 (SSS!.) 
positively rcliJted 

y n's 
y .i2 (SSSI.) 
n<»Rntlvfiy related 



y .1^ (Sl.LI.) 
po.<)ltivoiy related 

y n\s 
y (SI.LL) 

negatively related 



a 

SL 



a 

1-H 



NSL 



NSS 



I- 

1-3 



SL 
NSL 

ss 

NSS 



a 

1-B 
1-0 
1- P 
1-B 

a 

1-0 

1-P 
1-B 



SL 
NSL 
SS 
NSS 



SL 
NSL 
SS 
NSS 



NSL 



SS 
NSS 



•-I^SL 
1-H NSI. 

'-Pss 

'-•^NSS 



a 

l-P 
1-P 
1-B 
1-P 



SI. 

NSL 

SS 

NSS 



.10 


.05 


.025 


.01 


.005 


.10 


.05 


.025 


.01 


.005 


.088 


.035 


.019 


.006 


.005 


. 100 




mi 


. UUo 


nn?" 


.923 


.875 


.813 


.710 


.635 


.961 


. 929 


. 878 


T Q 1 




. 9A2 


.893 


.820 


. 701 


.603 


.980 


. 943 


b i 1 
.0/1 


. 705 


*» A 1 


.757 


.6A6 


.557 


. 393 


. 307 


.856 


. / /i 


i Q Q 


/ Q1 




.763 


.651 


.551 


.392 


.316 


.908 


.806 


.648 


.453 


.319 


.071 


.036 


.017 


.006 


.002 


.073 


mi 
. U J 1 




.005 


. KiXtH 


.956 


.896 


.836 


. 747 


.668 


.984 


. 9 j1 


. 887 


Toy 


.672 


.936 


.883 


.805 


.694 


.600 


.979 


. 947 


. 888 


TIT 




.756 


.6A8 


.537 


.416 


.314 


.861 


.765 


.6A 7 


.491 


. J / J 


.775 


.6A3 


.539 


.384 


.297 


.892 


.785 


.650 


.445 


.294 


.096 


.054 


.031 


.015 


.005 


.098 


.039 


n 1 T 


.006 


nm 


.955 


.915 


.86A 


.770 


.672 


.986 


. 963 


. 903 


. 802 


,0 fV 


.892 


.813 


. 717 


.594 


.503 ■ 


.943 


o c c 
. O.lJ 


.675 


y 1 n 


0 17 


.806 


.71A 


.597 


.458 


. 375 


.896 


. 819 


. 701 


.509 


. 359 


.676 


.5A6 


.433 


.289 


.210 


.777 


. oUo 


. J70 


1 m 


. uo / 


.oei 


.040 


.020 


.012 


.006 


.085 


.036 


.012 


.005 


.000 


.950 


.898 


.834 


.740 


.650 


.978 


.945 


.879 


.770 


.657 


.957 


.905 


.833 


.724 


.624 


.990 


.950 


.890 


.748 


.596 


.778 


.677 


.572 


.424 


.316 


.873 


.786 


.658 


.504 


.386 


.793 


.661 


.546 


.398 


.316 


.886 


.796 


.677 


.466 


.310 


.097 


.052 


.024 


.011 


.005 


.104 


.050 


.025 


.011 


.003 


.9A6 


.907 


.844 


.750 


.683 


.982 


.949 


.892 


.781 


.671 


.875 


.800 


.707 


.577 


.497 


.936 


.841 


.673 


.387 


.182 


.800 


.717 


.598 


.433 


.337 


.897 


.805 


.669 


.487 


.334 


.671 


.537 


.424 


.309 


.232 


.775 


.599 


.394 


.168 


.070 


.077 


.0A8 


.024 


.009 


.005 


.089 


.037 


.012 


.003 


.000 


.933 


.890 


.820 


.735 


.659 


.975 


.930 


.872 


.771 


.673 


.928 


.862 


.792 


.686 


.601 


.972 


.931 


.870 


.719 


.571 


.753 


.6A1 


.521 


.387 


.292 


.862 


.757 


.650 


.482 


.352 


.782 


.657 


.547 


.421 


.315 


.897 


.808 


.671 


.461 


.320 


.102 


.0A5 


.028 


.016 


.005 


.106 


.048 


.023 


.007 


.002 


.950 


.907 


.848 


.755 ■ 


.678 


.985 


.957 


.908 


.782 


.654 


.88A 


.797 


.714 


.589 


.503 


.945 


.859 


.678 


.408 


.207 


.831 


.72A 


.599 


.451 


.348 


.911 


.803 


.673 


.501 


.368 


.687 


.578 


.479 


.348 


.241 


.790 


.634 


.449 




.090 
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TABLE 11 

NormAl Population-Unequal Sample Sizes 



(Entries are the proportion of rejections 1n 1,000 experiments for the ANOVA r-test (F) and 

the Kruskal-Wallls Test (KW) In terms of probability of a Type I error (a) and power (1-b). 

Power Is based on four cases of mean differences (SL-stepwIse, large; NSL-nonstepwIse, 

large; SS-stepwIse, small; NSS-nonstepwIse, small). Alpha and power are observed under 
2 2 

three variance cases o*;, stepwise; f o^, SSSL, approximately In the ratio of 1:1:1:4; 

p 6 6 

and f Og, SLLL, approximately 1n the ratio of 1:4:4:4).} 

Sample Sizes » 11, 15, 19, 23 



set 



/ n's 

1 Og (stepwise) 
positively related 



f n's 
f o^- (stepwise) 
negatively related 



f n's 
f ^\ (SLLL) 
positively related 



f n's 
f (SLLL) 
negatively related 



f n's 
f ^\ (SSSL) 
positively related 



f n's 

f (SSSL) 
negatlvelyrelated 



'^SL 
^NSL 
^SS 
^NSS 



■"SL 
^NSL 
^SS 
^NSS 



''SL 
%L 
^SS 
^NSS 



-6 



'^SL 
^NSL 
SS 
^NSS 



-6 



"^SL 
^NSL 
SS 
^NSS 



°SL 
^NSL 
^SS 
^NSS 



10 


F 




m 




in 




KW 


01 


. uus 


.074 


.039 


.017 


.005 


.002 


.079 


.037 


.018 


.005 


.002 


.915 


.819 


.715 


.586 


.484 


.917 


.844 


.755 


.598 


.487 


.877 


.803 


.706 


.570 


.487 


.849 


.743 


.623 


.487 


.384 


.666 


.535 


.424 


.296 


.215 


.692 


.545 


.438 


• 294 


.206 


.652 


. 529 








fil7 

.01/ 


dRl 

. 40i 


. J Jc 




. 158 


.123 


.064 . 


.033 


.014 


.005 


.107 


.044 


.027 


.007 


.003 


.941 


.895 


.828 


.730 


.639 


.925 


.865 


.788 


.660 


.542 


.774 


.676 


.568 


.467 


.387 


.706 


.579 


.468 


.321 


.239 


.762 


.657 


.545 


.411 


.310 


.720 


.604 


.478 


.341 


.237 


.530 


.410 


.322 




. 1 / 


.454 


.329 


.223 


. 135 


.093 


.069 


.036 


.016 


.010 


.003 


.076 


.037 


.012 


.007 


.004 


.930 


.853 


.761 


.641 


.543 


.948 


.894 


.804 


.681 


.560 


.883 


.804 


.728 


.612 


.534 


.880 


.795 


.690 


.557 


.455 


.703 


.549 


.430 


.269 


.182 


.750 


.611 


.465 


.291 


.198 


.650 


.529 


.412 


.301 


.210 


.629 


.490 


.382 


.252 


.174 


.157 


.083 


.047' 


.024 


.014 


.138 


.065 


.033 


.015 


.010 


.964 


.928 


.870 


.778 


.685 


.959 


.927 


.871 


.747 


.633 


.757 


.662 


.574 


.453 


.358 


.710 


.587 


.473 


.346 


.248 


.791 


.666 


.552 


.419 


.323 


.783 


.667 


.539 


.393 


.298 


.546 


.433 


.336 


.237 


.174 


.499 


.360 


.259 


.160 


.115 


.073 


.041 


.021 


.011 


.005 


.090 


.039 


.023 


.006 


.002 


.854 


.776 


.701 


.575 


.487 


.885 


.808 


.699 


.573 


.476 


.792 


.704 


.624 


.516 


.4/^2 


.738 


.617 


.505 


.401 


.311 


.625 


.498 


.370 


.268 


.201 


.661 


.502 


.401 


.275 


.207 


.553 


.442 


.353 


.261 


.202 


.507 


.386 


.274 


.189 


.128 


.155 


.087 


.062 


.032 


.014 


.111 


.061 


.029 


.012 


.005 


.945 


.899 


.843 


.747 


.683 


.943 


.894 


.811 


.690 


.597 


.709 


.642 


.574 


.500 


.429 


.562 


.450 


.353 


.234 


.164 


.760 


.662 


.558 


.436 


.352 


.727 


.600 


.495 


.363 


.261 


.529 


.439 


.373 


.300 


.247 


.380 


.274 


.204 


.130 


.085 
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TABLE 12 

Exponential Populatlon-Unoqual Sample Size 



{Entries are the proportion of rejections 1n 1,000 experiments for the ANOVA F-test (F) 
and the Kruskal-Wallls Test (KW) In terms of probability of a Type I error (a) and power 
(l-sj. Power is based on four cases of mean differences (SL-stepwIse, larye; NSL-non- 

stepwise, large; SS-stepwIse, small; NSS-nonstepwIse small). Alpha and power are observed 

2 2 

under three variance cases (i< o^, stepwise; t o^, SSSL, approximately In the ratio of 
1:1:1:4; and ^ Og. SLLL, approximately In the ratio of 1:4:4:4).} 

Sample Sizes = 11, 15, 19, 23 



set 



f n»s 
^ Og (stepwise) 
positively related 



^ n's 

^ Og (stepwise) 
negatively related 



/ n's 
^ ol (SLLL) 
positively related 



f ol (SLLL) 
negatively related 



/ n's 

^ ol (SSSL) 
positively related 



/ n's 
/ 0^ (SSSL) 
negatively related 



-6 



SL 
^NSL 
SS 
^NSS 



^SL 
^NSL 
^SS 
^NSS 



-6, 



^NSL 
SS 
^NSS 



-6 



-6 



SL 
^NSL 
SS 
^NSS 



'^SL 

hs 

^NSS 



^SL 

^SS 
^NSS 



.10 


.05 


F 

.025 


.01 


.005 


.10 


.05 


.025 


.01 


.005 


.079 


.036 


.012 


.007 


.005 


.069 


.033 


.016 


.010 


.007 


.983 


.964 


.913 


.828 


.731 


.999 


.993 


.985 


.964 


.932 


.937 


.889 


.825 


.732 


.663 


.994 


.979 


.957 


.911 


.863 


.865 


.739 


.619 


.457 


.355 


.961 


.914 


.848 


.748 


. .658 


.776 


.667 


.547 


.406 


.306 


.928 


.858 


.750 


.619 


.504 


.122 


.061 


.033 


.018 


.010 


.119 


.061 


.031 


.013 


.006 


.982 


.954 


.918 


.844 


.781 


.997 


.992 


.984 


.963 


.938 


.843 


.745 


.641 


.499 


.414 


.970 


.915 


.823 


.632 


.491 


.844 


.762 


.668 


.531 


.446 


.965 


:918 


.840 


.721 


.620 


.611 


.501 


.402 


.275 


.224 


.797 


.650 


.500 


.302 


.184 


.069 


.033 


.013 


.003 


.000 


.092 


.042 


.021 


.004 


.003 


.985 


.956 


.918 


.822 


.713 


.998 


.497 


.996 


.991 


.970 


.937 


.867 


.797 


.687 


.597 


.996 


.990 


.982 


.943 


.894 


,859 


,738 


.598 


.434 


.318 


.971 


,939 


.896 


.805 


.713 


.777 


.650 


.527 


,373 


.287 


.937 


.891 


.810 


.690 


.571 


.157 


.086 


.046 


.024 


.015 


.140 


.080 


.041 


.021 


.007 


.996 


.990 


.970 


.932 


.874 


.1.00 


.999 


.998 


.989 


.979 


.887 


.785 


.683 


.571 


.480 


.984 


.948 


.879 


.735 


.565 


.944 


.891 


.799 


.653 


.551 


.990 


.967 


.937 


.855 


.776 


.674 


.542 


.423 


.306 


.243 


.839 


.710 


.562 


.387 


.270 


.104 


.053 


.032 


,.016 


.006 


.116 


.065 


.042 


.023 


.011 


.987 


.962 


.916 


.825 


.740 


.995 


.982 


.964 


.926. 


.881 


.969 


.940 


.894 


.833 


.753 


.996 


.975 


.949 


.896 


.842 


.867 


.768 


.653 


.507 


.403 


.919 


.846 


.770 


.655 


.566 


.868 


.777 


.661 


.525 


.419 


.883 


.793 


.686 


.539 


.440 


.197 


.123 


.082 


.048 


.032 


.144 


.091 


.053 


.022 


.010 


.978 


.963 


.942 


.909 


.858 


.996 


.993 


.983 


.965 


.947 


.910 


.858 


.787 


.694 


.613 


.924 


.861 


.754 


.606 


.482 


.877 


.810 


.739 


.625 


.528 


.961 


.909 


.849 


.738 


.654 


.749 


.660 


.573 


.466 


.392 


.706 


.565 


.432 


.280 


.183 
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TABLE 13 

Normal Population-Unequal Sample Sizes 



{Entries are the proportion of rejections 1n 1,000 experiments for the ANOVA F-test (F) 

and the K^ruskal-WalUs Test (KW) 1n terms of probability of a Type I error (a) and power 

(l-e). Power Is based or. four cases of mean differences (SL-stepwIse, large; NSL-non- 

stepwise, large; SS-stepwIse, small; NSS-nonstepwIse, small). Alpha and power are observed 

2 2 

under three varl/once cases (jf^ o^, stepwise; f o , SSSL, approximately In the ratio of 

\ p 6 " 

1:1:1:4; and i o^, SLLL, approximately In the ratio of 1:4:4:4).} 

Sample Sizes ^ lU 19» 19» 19 



a set 



f n»s 

2 

f Og (stepwise) 
pocltlvely related 



t n's 
i (stepwise) 
negatively related 



f o\ (SLLL) 
positively related 



i n's 
/ o\ (SLLL) 
negatively related 



c\ (SSSL) 
positively related 



f bl (SSSL) 
"negatively related 



^SL 
^NSL 
^SS 
^NSS 



-3 



SL 
^NSL 
^SS 
^NSS 



■"SL 
^NSL 
^SS 
^NSS 



SL 
NSL 
SS 
NSS 



^'SL 

^NSL 

^SS 



^SL 
%L 
^SS 
NSS 



.10 


.05 


.025 


.01 


.005 


.10 


or 
.UJ 


KW 
.025 


.01 


.005 


.084 


.035 


.021 


.011 


.007 


.089 


.041 


.020 


.007 


.002 


.908 


.828 


.748 


.608 


.503 


.909 


.832 


.732 


.586 


.473 


.867 


.781 


.702 


.583 


.505 


.806 


.711 


.600 


.458 


.369 


.709 


.563 


.435 


.286 


.213 


.711 


.561 


.430 


.279 


.191 


.654 


.519 


.394 


.297 


.224 


.588 


.447 


.324 


.208 


.153 


.154 


.092 


.050 


.026 


.017 


.134 


.068 


.031 


.016 


.007 


.942 


.887 


.829 


.723 


.640 


.927 


.870 


.797 


.673 


.579 


. 794 


.692 


.606 


.495 


.414 


.696 


.572 


.442 


.326 


.231 


.770 


.649 


.548 


.408 


.317 


.748 


.624 


.498 


.346 


.240 


.581 


.468 


.378 


.254 


.195 


.474 


.356 


.248 


.143 


.091 


.077 


.040 


.019 


.006 


.003 


.082 


.038 


.016 


.005 


.003 


.928 


.856 


.757 


.601 


.500 


.943 


.882 


.793 


.628 


.517 


.877 


.790 


.719 


.587 


.508 


.854 


.767 


.663 


.538 


.437 


.709 


.580 


.439 


.283 


.220 


.753 


.614 


.472 


.318 


.226 


.667 


. 548 


. 441 


.316 


.241 


.663 


.529 


.417 


. 274 


. 190 


.131 


.070 


.043 


.025 


.010 


.127 


.065 


.036 


.013 


.007 


.939 


.879 


.813 


.695 


.619 


.947 


.893 


.822 


.708 


.605 


.775 


.669 


.565 


.440 


.357 


.728 


.603 


.484 


.339 


.239 


.748 


.619 


.502 


.368 


.262 


.776 


.646 


.522 


.356 


.266 


.555 


,448 


.347 


.235 


.170 


.526 


.386 


.264 


.172 


.101 


.099 


.054 


.026 


.014 


.011 


.105 


.053 


.023 


.012 


.006 


.872 


.804 


.708 


.597 


.513 


.898 


.797 


.694 


.571 


.460 


.812 


.756 


.677 


.573 


.503 


.733 


.627 


.507 


.408 


.324 


.676 


.552 


.441 


.318 


.224 


.693 


.553 


.422 


.281 


.206 


.614 


.501 


.399 


.301 


.252 


.510 


.384 


.282 


.190 


.141 


.207 


.141 


.093 


.059 


.037 


.161 


.080 


.041 


.015 


.009 


.937 


.885 


.832 


.735 


.662 


.933 


.890 


.809 


.706 


.604 


.760 


.689 


.615 


.522 


.464 


.607 


.479 


.381 


.271 


.202 


.778 


.672 


.574 


.453 


.381 


.758 


.657 


.538 


.382 


.291 


.582 


.A95 


.409 


.318 


.251 


.426 


.315 


.225 


.136 


.089 



30 



TABLE 14 

Exponential Population-Unequal Sample Size 



{Entries are the proportion of rejections In 1,000 experiments for the ANOVA F-test (F) 

and the Kruskal-Wallls Test (KW) In terms of probability of a Type I error (a) and pwver 

(1-B). Power Is based on four cases of mean differences (SL-stepwIse , large; NSL-non- 

stepwlse, large; SS-stepwIse, small; NSS-nonstepwIse; small). Alpha and power are observed 

under three variance cases o^, stepwise; / SSSL, approximately In the ratio of 
2 e e 

1:1:1:4; and ^ Og, SLLL, approximately In the ratio of 1:4:4:4).} 
Sample Sizes = 11, 19, 19, 19 



a set 



^ n's 
i< Og (stepwise) 
positively related 



/ n's 
^ Og (stepwise) 
negatively related 



/ n's 
/ )SLLL) 
positively related 



/ n's 
/ (SLLL) . 
negatively related 



^ n's 
^ ol (SSSL) 
positively related 



^ n's 
/ (SSSL) 
negatively related 



'^SL 
^NSL 
^SS 
^NSS 



•^SL 
^NSL 
^SS 
^NSS 



^SL 
^NSL 
^SS 
^NSS 



^SL 
^NSL 
^SS 
^NSS 



-6, 



"SL 
^NSL 
^SS 
NSS 



'^SL 
^NSL 



.10 


.05 


F 

.025 


.01 


.005 


.10 


.05 


KW 
.025 


.01 


.005 


.097 


.049 


.026 


.010 


.003 


.094 


^048 


.029 


.010 


.003 


.986 


.963 


.924 


.845 


.765 


.999 


.995 


.991 


.966 


.947 


.949 


.903 


.836 


.752 


.671 


.994 


.984 


.967 


.917 


.872 


.883 


.773 


.657 


.521 


.404 


.959 


.928 


.877 


.778 


.679 




. /uj 






. J/D 




. ODD 


7fiQ 

, / D7 


.Ooi 


« DCJ 


.120 


.064 


.036 


.018 


.009 


. 127 


.065 


.037 


.016 


.007 


.993 


.979 


.962 


.908 


.850 


.999 


.998 


.992 


.980 


.956 


.882 


.817 


.720^ 


.614 


.527 


.976 


.931 


.849 


.705 


.562 


.922 


.874 


.794 


.657 


.561 


.974 


.951 


.903 


.822 


.743 


. /UD 




AQ7 

. 47/ 


. ODO 




. occ 


. DOO 




« 04O 




.082 


.042 


.020 


.013 


.007 


.091 


.042 


.019 


.011 


.008 


.973 


.944 


.893 


.784 


.697 


.1 .00 


.997 


.994 


.975 


.954 


.932 


.868 


.784 


.675 


.583 


.994 


.989 


.974 


.922 


.862 


.851 


.743 


.617 


.441 


.343 


.973 


.941 


.887 


.799 


.721 


.744 


.638 


.533 


.396 


.308 


.945 


.875 


.795 


.659 


.561 


.123 


.072 


.044 


.022 


.013 


.132 


.072 


.033 


.013 


.008 


.994 


.984 


.957 


.896 


.826 


1.00 


.996 


.993 


.984 


.972 


.883 


.783 


.686 


.573 


.470 


.989 


.959 


.888 


.726 


.583 


.927 


.859 


.740 


.581 


.485 


.986 


.966 


.932 


.842 


.756 


.637 


.523 


.426 


.314 


.251 


.836 


.716 


.579 


.385 


.272 


.120 


.068 


035 


.016 


.011 


.116 


.064 


.034 


.014 


.006 


.984 


.961 


.927 


.855 


.781 


.995 


.986 


.973 


.928 


.890 


.983 


.957 


.922 


.857 


.810 


.998 


.988 


.969 


.934 


.867 


.886 


.810 


.707 


.573 


.472 


.933 


.880 


.802 


.687 


.602 


.877 


.809 


.732 


.610 


.521 


.900 


.817 


.725 


.583 


.469 


.197 


.124 


.081 


.044 


.031 


.150 


.084 


.040 


.017 


.009 


.983 


.975 


.946 


.894 


.849 


.996 


.992 


.980 


.956 


.929 


.938 


.878 


.837 


.744 


.672 


.969 


.919 


.836 


.677 


.538 


.895 


.846 . 


.775 


.669 


.572 


.953 


.919 


.870 


.775 


.708 


.779 


.681 


.595 


.498 


.419 


.743 


.624 


.498 


.332 


.221 
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TABLE 15 

Schematic of Conditions Investigated ("X" Indicates Inclusion of the case. Each case was 
Investigated for a nom^l population and an exponential population using both the ANOVA 
F-test and the Kruskal-Wallis Test), 

i nj*s 



NSL 



1-Bc, 



stepwUfr 1-3 



^NSI 

ss 



SLLL 



l-6s| 
1-6, 



1-6, 



NSl 

SS 



NSS 



(7,7,7,7) (4,6,8,10) (4,8.8,8) (6,6.6.10) (11,15,19,23) (11,19.19.19) 


X 

- J 


X 

[ ... 


X 


X 








X 


X 


X 


X 


X 


pes. related 

2 

Hj 's and o^'s 


X 


X 


X 


X 


X 


neo. related 

n. s and o'-'s 
3 e 


X 


X 


X 


X 


X 


X 


pes. related 
nj's and o^'s 


X 


X 


X 


X 


X 


neg. related 
n^'s and o^'s 


X 


X 


X 


X 


X 


X 


pes. related 
nj's and o^'s 


X 


X 


X 


X 


X 


neg. related 
nj's and o^'s 



' e 
SSSL 



1-' . 



'nss 



n - sample size per treatment level 



SL - a stepwise difference such that power was approximately .86 for o=.05 for the nonnal distribution 
NSL - a nonS"^Dw'se difference fl;l;l:4) such that power was approximately .86 for a^.05 for the normal 
distribution 

SS - a stepwise difference such that power was approximately .60 for o=.05 for the nonnal distribution 
NSS - a nonstepwise difference (1:1:1:4) such that power was approximately .60 for a*. 05 for the normal 
d strlbution 



Stepwise - variances in the ratio of 1:2:3:4 
SLLL - variances In the ratio of 1:4:4:4 
SSSL - variances in the ratio of 1:1:1:4 
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